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We study the small-world networks recently introduced by Watts and Strogatz [Nature 393, 
^q' 440 (1998)], using analytical as well as numerical tools. We characterize the geometrical properties 

resulting from the coexistence of a local structure and random long-range connections, and we ex- 
amine their evolution with size and disorder strength. We show that any finite value of the disorder 
is able to trigger a "small-world" behaviour as soon as the initial lattice is big enough, and study 
■ the crossover between a regular lattice and a "small-world" one. These results are corroborated 

by the investigation of an Ising model defined on the network, showing for every finite disorder 
fraction a crossover from a high-temperature region dominated by the underlying one-dimensional 
structure to a mean-field like low-temperature region. In particular there exists a finite-temperature 
<—j ' ferromagnetic phase transition as soon as the disorder strength is finite. 



< 



o 
o 



S3 



PACS numbers: 05.50.+q 64.60.C 05.70.Fh 



I. INTRODUCTION 

T3 

A recent article by Watts and Strogatz jf], showing the relevance of what they called "small- world" networks for 
many realistic situations, has triggered a lot of attention for these kind of networks Q-Q]: this interest results from 
their very definition, allowing an exploration between regular and random networks. 

Random networks have of course been the subject of many studies in various domains, ranging from physics to 
social sciences. A very important characteristic common to such lattices and for example social networks is that the 
length of the shortest chain connecting two vertices (or members) grows very slowly, i.e. in general logarithmically, 
with the size of the network ||. This characteristic has important consequences for many issues, e.g. the speed of 
disease spreading |Q etc. The social psychologist S. Milgram Q, after realizing that the number of persons necessary 
£C) , to link two randomly chosen, geographically separated persons had a median number of six, has called this concept 
the "six degrees of separation" . In addition, models defined on random networks are, due to their locally tree-like 
ON , structure, of mean-field type, and can therefore be analytically more tractable than their counterparts defined on 
ON . regular lattices, but, thanks to the finite connectivity of their vertices, they display however behaviours which are 
intrinsically not captured by the familiar infinite connectivity models JTo| . 

However, it is well known that many realistic networks have a local structure which is very different from random 
networks with finite connectivity. For example, two neighbours have many common neighbours, a property which 



. does not hold for random networks, and which can be quantified by the introduction of the "clustering coefficient" (see 
section III). Such phenomena are not only found in social networks, but also e.g. in the connections of neural networks 
jlj or in the chemical bond structure of long macromolecules pd| ]: The one-dimensional couplings of neighbouring 
O ■ monomers are complemented by long-ranged interactions between monomers that are close in space although not 
along the chain. This interplay has been studied in fact for example in but it seems that, in this case, the 
• »"H . long-range interactions are not sufficient to really modify the properties of the one-dimensional structure of the chain 

>< : g. 

The construction proposed by Watts and Strogatz Jlj], that we will recall in section ||, allows to reconcile local 
properties of a regular network with global properties of a random one, by introducing a certain amount of random 
long-range connections into an initially regular network. 

The aim of this paper is to study in some detail the concepts used in jlj to characterize the "small-world" behaviour, 
caused by the coexistence of "short-range" and "long-range" connections. We will show that this behaviour does not 



x for example, an Ising model defined on a self-avoiding walk with interactions between monomers neighbours in space and not 
only on the chain has a critical temperature T c = 0, as for a one-dimensional chain [|12] 
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appear at a finite value of the disorder p, but that, for any p > 0, the networks will display this behaviour as soon as 
their size is large enough. 

This paper is organized as follows. In section || we describe the procedure used to obtain small-world networks; 
in section [II we study some of their geometrical properties, i.e. the connectivity, the chemical distances and the 
"clustering" coefficient, analytically as well as numerically Section IV contains the investigation of an Ising-model 
defined on a small-world lattice, where the interplay between the short- and long-range interactions leads to interesting 
physical effects. 



II. DEFINITION OF THE MODEL(S) 

The construction algorithm proposed by Watts and Strogatz for small-world networks is the following: the initial 
network is a one-dimensional lattice of N sites, with periodic boundary conditions (i.e. a ring), each vertex being 
connected to its 2k nearest neighbours. The vertices are then visited one after the other; each link connecting a vertex 
to one of its k nearest neighbours in the clockwise sense is left in place with probability 1 — p, and with probability p 
is reconnected to a randomly chosen other vertex. Long range connections are therefore introduced. Note that, even 
for p = 1, the network keeps some memory of the procedure and is not locally equivalent to a random network: each 
vertex has indeed at least k neighbours. An important consequence is that we have no isolated vertices, and the graph 
has usually only one component (a random graph has usually many components of various sizes). 
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FIG. 1. Examples of networks obtained by the procedure described in the text 
networks; (b), (c): intermediate values of p; (d): p = 1. 




(a): p = 0, regular 



It is possible to obtain "small-world" networks in other ways, that yields the same physical consequences, and 
can be more tractable analytically. For example, the networks studied in are obtained by adding long-range 
connections to the initial ring without diluting its one-dimensional structure; the mean connectivity then changes 
with the disorder. In section [V we will also study an initial network with multiple links between successive vertices. 



III. GEOMETRICAL PROPERTIES 



2 Results in particular about the chemical distances and the onset of the small-world behaviour can also be found in §J^>§~Q] 
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A. Connectivity 



For p — 0, each vertex has the same connectivity 2k. On the other hand, a non-zero value of p introduces disorder 
into the network, in the form of a non-uniform connectivity, while maintaining a fixed average connectivity c = 2k. 
Let us denote P P (c) the probability distribution of the connectivities. 

Since k of the initial 2k connections of each vertex are left untouched by the construction, the connectivity of a 
vertex i can be written Cj = k + m, with m > 0. rii can then again be divided in two parts: n\ < k links have been 
left in place (each one with probability 1 — p), the other nf — rii — n\ links have been reconnected towards i, each one 
with probability p/N. We readily obtain 

Pi(n})=(^)(l- P rh k - ni (1) 



P 2 (nf) = v y l exp (-pk) for large N (2) 



and find 



min(c— k : k) 



Pp (c)= y: (*) a - p)v-* f l M r_ nv exp ( ~ pfc) ' c ^ fc - (3) 

We show in figure (^|) the probability distributions for k — 3 and various values of p: as p grows, the distribution 
becomes broader. 



P p (c) 
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FIG. 2. Probability distributions of the connectivity c for k — 3 and various values of p: c > k, and the mean connectivity 
is c = 2k — 6. Fhe symbols are obtained by numerical simulations of small- world networks (with iV = 1000 vertices), and 
the lines are a guide to the eye, joining points given by formula (0). Filled circles show the probability distribution of the 
connectivity c for a random network of mean connectivity is c = 2k = 6 (given by (2k) c exp(— 2k)/c\). 



B. Chemical distances 



We now turn to a non-local quantity of graphs: the chemical distance between its vertices, i.e. the minimal number 
of links between two vertices. We note dij the chemical distance between vertices i and j, and 



the mean chemical distance, averaged over all pairs of vertices and over the disorder induced by the rewiring procedure. 
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Watts and Strogatz have shown that the mean distance between vertices £(N,p) decreases very rapidly as soon as 
p is non-zero. They however show the curve of £(N,p) versus p for only one value of N and do not study how it 
depends on N. For p = 0, we have a linear chain of sites, so that we easily find 

niV ' Uj " 4fc(iV-l) 4fc' (5) 



growing like N. On the other hand, for p = 1 £(N, 1) grows like ln(JV)/ ln(2fc — 1) (inset of figure (Eh): the graph is 
then random. Besides, the distribution of lengths, being uniform between 1 (shortest possible distance) and N /(2k) 
for the linear chain, becomes more and more peaked around its mean value as p grows (see figure ([?]))■ 

It is therefore quite natural to ask if the change between these two behaviours occurs by a transition at a certain 
finite critical value of p or if there is a crossover phenomenon at any finite value of N, with a transition occurring 
only at p = 0. This last scenario was first proposed in 0. 




. N/(2k) 

1 

FIG. 3. Probability distribution of the distance dij between two vertices i and j of small-world graphs, for k — 3, N — 2000, 
p — 2~ 20 (flat distribution), p — 2~ 12 , 2~ 10 and 2 -8 (curves becoming more and more peaked as p grows), averaged over 500 
samples for each p. The maximum value of dij is of course N/(2k). Inset: £(N, 1) versus TV for k — 3 and k — 5, together with 
the ln(/V)/ln(2fc - 1) straight lines. 



We first investigate this question by numerical simulations, to study the behaviour of £(N,p) in a systematic way, 
varying N and p: we use values of N from 100 to 20000, with p — 2 a /2 20 , a = 0, • • • , 20, and we average over 500 
realizations of the disorder for each value of p. We have studied three different values of the mean connectivity: 
2k = 4, 6 and 10. 

In figure §), we plot £(N,p)/£(N,0) for various values of N and k = 2. It is clear that £(N,p) decreases very fast 
already for small p (note the logarithmic scale for p): from this point of view, the network is very soon similar to a 
random network. In particular, as N becomes larger, the drop in the curve occurs for smaller and smaller values of 
p, showing that no finite critical value of p can be determined this way: in the thermodynamic limit, £(N,p)/£(N, 0) 
goes to for all p > 0. This is a first clear indication of a crossover behaviour (as opposed to a transition at a non-zero 
p) that we are now going to examine in more details. 

Note that the first evidence of a crossover has been given in by the numerical study of system with sizes up to 
N = 1000, and mean connectivities 2k = 10, 20, 30. A scaling of the form 

£(N,p) ~ N*F k (JL^j (6) 

was proposed, where F k depends only on k, with F k (u < 1) ~ «, F k (u ^> 1) ~ lnu, and N* ~ p~ T with r = 2/3 as 
p goes to zero. However, it can be shown with a simple but rigorous argument, that r cannot in fact be lower 
than 1: the mean number of rewired links is N r = pNk; if r < 1, and if we take a such that r < a < 1, then the 
scaling hypothesis implies, for large N, £(N, N~ x / a ) ~ N T / a hx(N) (since N 1 ~ T / a ^s> 1 for large N); N r however goes 
to zero for large N, so that the rewiring of a vanishing number of links could lead to a change in the scaling of £. This 
obviously unphysical result shows that the hypothesis r < 1 is not valid. In addition, Newman and Watts M, using 
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a renormalization group analysis, have shown that r = 1 exactly. Here we will arrive at the same result, using our 
numerical simulations to test the scaling hypothesis, as well as analytical arguments. 



l(N,p)/l(N,0) 
1 




FIG. 4. Mean chemical length £(N,p) normalized by £(N,0), versus p, for k — 2, and N from 100 to 20000: the drop in the 
curve occurs at lower and lower values of p as N grows. 

To understand how strong the disorder has to be to induce a crossover, and to show that this crossover can occur, 
at fixed p, for N* ~ p~ T , or equivalently, at fixed N, for p* ~ iV~ 1 / r , only with r > 1, we study the case of a finite 
number of rewired links, N r = a. This corresponds to p — a/N. In order to show that such a value of p is not able 
to alter the scaling of I with N, we now establish a rigorous lower bound. 

For any given sample, the extremities of the a rewired links determine 2a intervals. The sum of their lengths on the 
ring is N, so that at least one of them has a length of order N, which is, even more precisely, larger than TV/ (2a). We 
call this intervalJ = [io,io] and we consider the interval / c J, of length N/(4a) — bN, I — [io+N/(8a),i +3N/(8a)], 
which has not been modified by the rewiring procedure. We now decompose the mean length between two vertices of 
the sample, 



T-l) XX' 



N(N — 1) 

into two contributions: the first one comes from the pairs with i £ I, j G /, the second one includes all pairs 
(i,j) where at least one of the vertices is not an element of /. The first contribution can be estimated by formula (jg), 
since it comes from a part of the graph which has not been modified, and at a distance big enough from any modified 
link: 



bN 



l3 > ( b N)(bN-l) — 



(the inequality comes from the fact that we do not have periodic boundary conditions for this interval). We now 
have access to a lower bound of £(N, a/N) (which is valid for any sample, and consequently also for the average over 
samples) : 

b 3 



1 b A 
£(N,a/N)> — r V da > — N. 



N(N-1) . f-' r 

Since £(N,a/N) is smaller than £(N, 0) ~ N/(4k), this shows that 

£{N,a/N) = 0{N). 



In other words, a finite number of rewired links cannot change the scaling at large N: £{N,a/N) is of order N for 
any finite a. 
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To complete this argument, we have computed numerically Pi/2(N), i.e. the value of p such that £(N, Pi/2{N)) = 
£(N,Q)/2. Figure (||) shows quite clearly that, for large N, p\/2{N) ~ 1/N: a finite number of rewired links is able 
to divide the mean length between vertices by two f\ 



P 1/2 (N) 
10" 1 



10 



10 



10 




100 



1000 



10000 



FIG. 5. P!/ 2 (N) such that £(N,p 1/2 {N)) = £(N,0)/2, versus N, for k = 2, 3, 5. The straight line is proportional to 1/N. 

Let us now go back to the scaling hypothesis of 0. If the scaling form of equation (||) is valid, we have to compute 
£(N,p) at fixed p in order to estimate N*(p). For large N, it behaves like N*(p)\n(N) (see figure ([}]) for different 
values of p). For small p, N*(p) becomes bigger and bigger, so that we have to use larger and larger values of N. We 
show in figure (Q) that the N (p) estimated in this way behaves like 1/p for small p (and for p — > 1, N*(p) — > ln(2fc — 1), 
in accordance with ^(iV, 1) ~ ln(iV)/ln(2fe — 1)), giving r = 1. This is not very surprising if we consider the above 
discussion showing that a finite number of rewired links will change the coefficient of the scaling of £ with iV but 
not the scaling itself. Moreover, Pi/2(N) corresponds to the drop in the curves of figure (Q) and can therefore be 
considered as a crossover value. 
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As shown in 



N* 



p T implies Pi/2(N) ~ iV ' T ; we thus have a clear indication that r = 1. 
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FIG. 6. £(N,p) versus N, for p = 2~ a , a = 6, • • ■ , 11, and k — 3. For large values of p we have a straight line in the semi-log 
plot, while for small values of p we observe the crossover between £{N,p) ~ JV and £(N,p) ~ ln(iV). The value of N*(p) is 
given by the slope of the linear part in the semi-log plot. 
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FIG. 7. N*(p) versus p for k = 2, 3, 5. The straight line is proportional to 1/p. 

Using the determined values of N* , we plot in figure (g) £(N,p)/N*(p) versus N/N*(p) for various values of iV 
and p. We observe a nice collapse of the data for each value of k. Thanks to the range of values of N that we use, 
we are able to show the collapse over a much wider range of values than ||. We clearly see the linear behaviour 
Fk(x <1)~ x/(4fc), and the crossover to Fk(x ^> 1) ~ ln(x). Note that, as explained in g), we have to use values of 
p lower than 1/fc 2 (and of course large enough values of N, i.e. N ^> k) to obtain a clean scaling behaviour: for too 
large p, we are moving out of the scaling regime close to the p = O-transition. 
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FIG. 8. Data collapse £(N,p)/N* (p) versus N/N*(p), for k = 2 and k = 5; (a): log-linear scale showing at large N/N* the 
logarithmic behaviour; (b) linear scale showing at small N/N* the linear behaviour £(N,p) ~ N/(4k): the straight lines have 
slopes 1/8 and 1/20. 



C. Clustering coefficient 

To define the "small- world" behaviour, two ingredients are used by Watts and Strogatz [Q. The first one is the 
chemical length studied in the previous paragraph, which depends strongly on p and N. The second one is more local: 
the "clustering coefficient" C(p) quantifies its "cliquishness" . C(p) is indeed defined as follows: if Cj is the number 
of neighbours of a vertex i, there are a priori Ci{ci — l)/2 possible links between these neighbours. Denoting Ci the 
fraction of these links that are really present in the graph, C(p) is the average of Ci over all vertices. On a linear-log 
plot, C(p)/C(Q) is close to 1 for a wide range of values of p, and its drop occurs around p » 0.1. This is therefore in 
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contrast with £(N,p), whose drop occurs for much smaller values of p as soon as N is large enough. It is therefore an 
interesting question whether there is an upper threshold on p for the small-world behaviour. 

We now show that a simple redefinition of C(p) leads to a very simple formula, without altering its physical 
signification, nor the shape of the curve. For p = 0, each vertex has 2k neighbours; it is easy to see that the number 
of links between these neig hbours is Wo = 3fc(fc - l)/2. Then C(0) = 2(L-i) ■ For P > °> tw0 

neighbours of i that 

were connected at p — are still neighbours of i and linked together with probability (1 — p) 3 , up to terms of order 
-k. The mean number of links between the neighbours of a vertex is then clearly A/"o(l — p) 3 + 0(-^). The clustering 
coefficient C(p) is defined as the mean of the ratio Ci = c ^ c J ^2 1 y 2 ■ ^ ms tead we define C{p) as the ratio of the mean 
number of links between the neighbours of a vertex and the mean number of possible links between the neighbours of 
a vertex, we obtain 



(S) 



We check numerically, with N — 50 to N = 8000, and averaging over 5000 samples, that the two definitions 
lead to the same behaviour (we see in figure (||) that the difference between C{p) and C{p) is very small), and that 
the corrections to eq. are indeed of order X/N. The behaviour of C(p) is therefore very simply described by 
C(p) » C(0)(1 — p) 3 , and the dependence on N is very small. 
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FIG. 9. C(p) and C(p) versus p, for k = 2 (C(0) = C(0) = 0.5), N = 1000, 2000, 5000: open symbols are for C(p), and the 
crosses are for C(p); the line is C(0)(1 — p) 3 . Inset: corrections C(p) — C(0)(1 — p) 3 (filled symbols) for iV = 1000 (circles), 
N = 2000 (squares) and N = 5000 (triangles), and C(p) - C(0)(1 - p) 3 (open symbols) for N = 1000 (circles), TV = 2000 
(squares) and = 5000 (triangles). We see that the corrections go to zero as 1/N for C(p); the corrections for C(p) axe larger, 
but anyway very small. 



To summarize this section, we have shown that the small-world behaviour - as defined by the average chemical 
distance and the clustering coefficient - is indeed present for any finite value of < p < 1 as soon as the network is 
large enough. 



IV. ISING MODEL 



In this section we want to investigate the consequences of the mixed geometrical structure of small- world networks 
on an Ising model as a prototype of statistical- mechanics models that can be defined on it. This model can be 
understood as a continuous interpolation of a pure one-dimensional model for p = showing no phase transition at 
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finite temperature to a model on a random graphQ for p = 1 havin g a finite critical temperature T c (p — 1) > as 
long as k > 2, cf. Jl3|]. In agreement with the results from section III, we find for every finite p > that the low 
temperature behaviour of the model is of mean-field character, even if we observe a finite temperature crossover to 
a dominance of the one-dimensional structure. This observation confirms the value p c — for the onset of a non- 
trivial thermodynamical small-world behaviour as already found in the geometrical properties, and it shows again 
the crucial importance of the mixed geometrical structure, as even global quantities can be dominated by the initial 
ordered structure for high temperatures. 



A. General formalism 



The system we want to study is given by its Hamiltonian 

N k 

H({S i }) = -Y,SiJ2 S ™(i,j) (9) 
i=l j=l 

with N Ising spins Si = ±1, i = 1, ...,N, and periodic boundary conditions, i.e. we identify Sn+i = Si etc. in the 
following. The independently and identically distributed numbers m(i,j) are drawn from the probability distribution 

N 

P(m(i,j)) = (1 -p)5 m { t , 3 ), l+j + -Tf^2S m (i,j),i, (10) 

i=i 

i.e. for p = we obtain a pure one-dimensional Ising model where every site is connected to its 2k nearest neighbours 
by ferromagnetic bonds of strength 1, whereas this structure is completely replaced by random long-range bonds for 
p = 1. The number of bonds in the model is given by kN , independently of the disorder strength p. Here we consider 
only the case of finite probabilities p = O(l), i.e. an extensive number of links is rewired and, according to the last 
section, we are therefore in the small-world regime. 

In order to decide whether there exists a ferromagnetic phase transition at finite temperature or not, we have to 
calculate the free-energy density at inverse temperature (3. Due to the existence of an extensive number as well of 
random as of one-dimensional links and due to the translational invariance of the distribution ([h]) we expect this 
quantity to be self-averaging, we therefore have to determine 

/ = — lim -—In Z 

N^oo BN 

= _ lim llnVe-WfS-l) . (11) 

The average (•) over the disorder distribution P(m(i,j)) is achieved with the help of the replica trick 

In~Z = lim a„Z^ (12) 
n— *0 

by introducing at first a positive integer number n of replicas of the original system, averaging over the disorder and 
sending n — > at the end of the calculations. Thus the replicated and disorder averaged partition function can be 
written as 



Z" = ]Texp -/3 $>({£?}) 

{Si} I a=l 



N 




Enn d-^+K^i ( i3 ) 

{S i }i=lj = l \ 



4 As already mentioned in the introduction, every point in this model has a minimal connectivity k. So, even in the case 
p = 1, the model is not equivalent to the usual random graph where both endpoints of a link are chosen randomly. 







where we introduced the replicated Ising spins S, = (Sj, S 1 ™). This expression can be simplified by defining the 2™ 
order parameters fTifl 

c(S):=^f>*,s (14) 

i=l 

giving the fraction of n-tuples in {Si} which are equal to S € { — l,+l} n , and their conjugates c(S). These order 
parameters have to be normalized, ^ s c(S) = 1. After a change c — *• id leading to real order parameters, we arrive at 



lntr T" 

N 



zn = J n & ( s ) rf£ ( s ) ex p | ^ (- e c ( s ) £ ( s ) + ^ 

= fl]&(S)(ic(S)exp{JV/Jc,c]} (15) 
^ s 

with an effective 2 kn x 2 fcn -transfer matrix T given by its entries 

k k / \ 

T(Si, S fe |S fc+1 , S 2fe ) = J] e £ ^) J] (1 - p)e^ s ^ + p]T c (S)e^ s . (16) 

i=l 3=1 V S / 

At this point we remark that the small-world Ising model offers an interesting interplay between technical concepts 
of mean-field theory, as represented by the global order parameters, and the theory of one-dimensional systems, here 
represented by the effective transfer matrix. As in the conventional transfer matrix method, the contribution of the 
second term in /„ can be determined by the largest eigenvalue of T with right (left) eigenvector |A r ) ((A/|), 

/„ [c, c] = -J2 c(S)«(S) + In , (17) 

but in order to calculate the integrals over the order parameters in ( |l5| ) we have to use the saddle point method which 
implies 

/ o \ (A;|S, Si, S fc _i)(S, Si, S fc ^i|A r ) 

C(S) " s \ <MK) ' (18) 

i.e. the explicit form of the transfer matrix itself depends on the eigenvectors, and the linear structure of the eigenvalue 
equations is destroyed. 



B. High-temperature solution 

The problem simplifies significantly in its high-temperature phase where the correct solution of the saddle point 
equations 

c(S) = A7^) lntrTf 

^=^ lntrTf (19) 

can be found without knowing the above-mentioned eigenvectors and is given by the paramagnetic values c pm (S) = 
1/2" and c pm (S) = kpa n . a does not depend on S, so it can be taken out of lntrT"^" and cancels finally with 
— ^2 cc in ([l5]) . In this phase all replicated spins S have the same density, and thus the average magnetization 
m = lim„^ J2s S 1 c(S) as well as the overlaps q ab = lim n _> 2s S a S b c(S) vanish. 

Even if this solution exists for all temperatures, it is not stable for low temperatures. The critical temperature can 
be determined by investigating the 2 n+1 -dimensional fluctuation matrix 
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fd 2 fn 



c, c 



9c dc 



d 2 fn[c, 

V 9c 9c 



9 2 /»[c,c] \ 
9c 9c 

9 2 /„[c,c] 

9c 9c J 



(20) 



The paramagnetic solution is valid as long as none of the eigenvalues of this matrix changes sign 0. The phase 
transition therefore appears at the point where the first eigenvalue becomes zero and the system becomes unstable 
with respect to Gaussian fluctuations around the given saddle point. 

C. Crossover from one-dimensional to mean- field behaviour 

The problem in calculating these eigenvalues consists in the fact that the transfer matrix T is given by a sum over 
non-commuting matrices. So it is not clear how to obtain the eigenvectors of T even at the paramagnetic saddle point 
where the problem can be linearized again because we already know c and c and the form of the transfer matrix is 
fixed. 

At this moment we therefore restrict to the most interesting case of small p <C 1 and treat the problem by means 
of a first order perturbation theory in p around the pure one-dimensional model. In this case we arc in principle able 
to calculate all the (^-dependent) eigenvectors, which are simple direct products of n eigenvectors of the pure and 
unreplicated transfer matrix, and hence the perturbation-theoretic corrections to their eigenvalues. The linearized 
transfer matrix reads 



T;,:n(Si, Sfc|S 



k+1, 



,S 2 fc) = cxp 



- (3 S,S, . , 



k 

i-fc 2 P + P y>(s) ^ 



s 



P, 9=1 



exp{/3Sp(S - S p+q )} 



(21) 



As we show in some detail in Appendix A from the analysis of the entries of the fluctuation matrix (|20|), this 
perturbation expansion contains powers of a term proportional to p£o with £o being the correlation length of the pure 
system, and its first order approximation consequently breaks down when p£o becomes larger than O(l) for increasing 
disorder p or decreasing temperature T. In the pure model the correlation length diverges for low temperatures as 

Co oc e fc (fc+D/3 . (22) 

Consequently, at fixed but low temperature T, we find a crossover from a weakly perturbated one-dimensional be- 
haviour for disorder strengths p <C p co (T) with 



p co (T) oc exp 



-fc(fc+l) 
f 



(23) 



to a disorder-dominated and hence mean-field like regime for larger p. This can be understood by a simple physical 
argument. We consider a cluster of correlated spins in the pure model which has a typical length scale I ~ £o- Thus 
the number of links in this cluster is also O(£o) for finite k, and the average number of redirected links in this cluster 
at disorder strength p is approximately p^ . For p <C p co {T) there are on average consequently less than one redirected 
link per cluster, and the system is not seriously perturbated by the disorder. The opposite holds for larger p. 

This shows that an arbitrarily small, but finite fraction p of redirected links ( "short cuts" in the graph) leads at 
sufficiently small temperature T < T co (p), 



T co (p) oc 



fe(fc + 1) 
log(p) 



(24) 



to a change of the behaviour of the model from a one-dimensional to a mean-field one, which nicely underlines the 
importance of both geometrical structures in the small- world lattice. 



5 Due to the common change c 
stable saddle point. 



ic one half of the eigenvalues has to be negative, the other half positive in order to insure a 
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D. The ferromagnetic phase transition 



In the low-temperature regime T -C T co (p) the thermodynamic behaviour is dominated by the mean-held type 
disorder, and we expect a hnite temperature transition to a ferromagnetically ordered phase at finite temperature 
T c (p) at least for sufficiently large p and k > 2. Due to the above-mentioned technical problems in diagonalizing 
the transfer matrix we cannot calculate this transition analytically, and we compute therefore the full line T c (p) for 
k = 2 and k — 3 by means of numerical simulations. We use a cluster algorithm EB| to compute the equilibrium 
distribution of the magnetization, for system sizes rangin g fr om N = 500 to N = 8000, and use Binder cumulants 
fl6f to determine the critical point (see the inset of figure ( |lo|) for an example) . 

The important result is that we obtain a transition at a non-zero temperature for all the investigated values of p. 
Moreover, for small p we have, as shown in figure (|Io|): 

9k 

Tc(p) oc -— -. (25) 
log(p) 




FIG. 10. Inverse critical temperature f3 c (p) for k = 2 (circles) and k — 3 (diamonds). The full lines show the asymp- 
totic scaling ( p5j ) of (3 c (p <C 1). The scaling (^i|) of the crossover between one-dimensional and mean-field behaviour is given 
by the dashed lines - and consistently found to be at higher temperatures as the ferromagnetic phase transition. The in- 
set shows the /3-dependence of the Binder cumulant used to determine the critical temperature for p — 0.1, k = 3 and 
N = 500, 1000, 2000, 5000 (triangles, diamonds, squares, circles). 

This transition line is found to be always at smaller temperatures than the crossover temperatures, which illustrates 
again the mean-field character of the phase transition. 

Even if the behaviour of the system is dominated by the random part of its Hamiltonian, the underlying one- 
dimensional structure is crucial for the existence of the phase transition and for the explicit value of the transition 
temperature. This becomes clear from the fact that only the existence of the short-range links leads to the existence 
of a macroscopic cluster for p below the percolation threshold of the random bonds, and can be supported analytically 
by investigating a version of the model where all one-dimensional bonds are deleted and only the random bonds for 
fixed p are conserved. This model shows a ferromagnetic transition only above p c (k) = 1 — \JJjk — l)/k. So, even if 
the phase transition is induced by the presence of long-range interactions, it is based on an interplay between both 
structures. 



E. A simplified model 



In this subsection we present a slightly modified model where the full procedure introduced in section IV A can be 
followed analytically, and the phase diagram can be calculated explicitly. The model has the same Hamiltonian (Q), 
but its disorder distribution is given by 
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N 



P(m(i, j)) = (1 - p)6 m (i i j) ti+1 + — s m(id),i ■ ( 26 ) 

1=1 

So the underlying one-dimensional graph is changed: instead of having bonds to the next 2k neighbours it includes k 
bonds to each of the two next nearest neighbours (which, in the pure case, is equivalent to one bond of strength k). In 
the disordered version every of these bonds is replaced with probability p by a random bond, so the random structure 
of the model remains unchanged compared to the original model. Anyway, this model remains a "valid" small-world 
network as it consists of a mixture of a regular low-dimensional with a random long-ranged lattice. This can e.g. be 
confirmed by the fact that our simplified model also shows the scaling behaviour (|6|) with the same scaling exponent 
r = 1 as the latter depends only on the dimensionality of the regular structure, cf. S. Because of the geometrical 
similarity of the underlying networks we expect also a qualitatively similar thermodynamic behaviour. 

Again we average the replicated partition function over the disorder and introduce the order parameters c(S) and 
c(S). By doing this we arrive again at 

Z*= fl[d C (S) dc(S)exp{Nf n [c,c}} (27) 
^ s 

with a slightly changed /„, 



/ n [c,c]=-^c(S)c(S) + llntrT iv (28) 
s 

where the effective transfer matrix is of dimension 2™ and reads 



T(Si|S 2 ) = e £(Sl 



(l-p) exp{/3Si -S 2 }+ P J2 c(S) exp{/3Si • S} 



(29) 



Also in this case, the simple paramagnetic saddle point for c and c is given by c pm (S) = 1/2™, c pm (S) = kpa n with 
a /3-dependent a canceling in (|2q), which therefore becomes 



1 

- In trip,,,, 

with 



fn[Cpm?Cp7n] — j. 7 hi trT„ m (^0) 



T pm (S 1 |S 2 ) = [(l-p)exp{/3S 1 -S 2 }+p(cosh/?n fe . (31) 

This matrix can be easily diagonalized by introducing the two-dimensional orthonormalized vectors |+) = 1/V2 (1,1) 
and |— ) = 1/V2 (1, —1). The eigenvectors of T pm are = l^i 1 ) ® ■ ■ ■ (g> \fi n ) with fi a = +, - for all a = 1, n. With 
p(fi) being the number of factors |+) in \fi) t the eigenvalues are found to be 

X[fi] =X(p{p))=J2 ( fc )(pcosh/3") J (l -p) fc ^(2cosh(fc-j)/3)"W(2sinh(fc- j)(3) n - p ^ . (32) 

]=0 

The behaviour of f n in the thermodynamic limit N 00 is completely determined by the largest eigenvalue X(n) = 
A [+...+], and the paramagnetic free energy of the model reads 



Pfpm = lim d n f n [c p 

n — >0 

k <k 



= J2[ . 1^(1 -p) k ~ 3 ' (jlncosh/3 + ln2cosh(fc- j)(3) . (33) 

3=0 

The second eigenvalue A(n — 1) = A[ — h ...+] of the transfer matrix T pm describes in the replica limit n — > the 



IIIB 



decay of the two-point correlation function (SiSj) cx A(n— l)l l_ J*l for distances 1 <C <C £(N,p), cf. section 

i.e. for points i and j whose chemical distance is given with finite probability by the one-dimensional distance \i — j 
and does not include random bonds. The corresponding correlation length reads 
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€p = — lim 



1 



o In X(n - 1) 



in (e}=o (jy (i - p) k ~ j tanh ( fc - fie) 



(34) 



and remains finite for every non-zero temperature. So, in complete agreement with our findings for the original model 
in the last subsections, we can conclude that the modified model has no ferromagnetic phase transition caused by 
a divergence of the one-dimensional correlation length. There is nevertheless a transition due to the fact that the 
paramagnetic saddle point c pm (S) and c„ m (S) becomes unstable at a certain temperature. In order to see this we 
investigate again the fluctuation matrix (|20| ) for the present model. The four blocks can be calculated (see appendix 
B for details), and diagonalized simultaneously The fluctuation mode becoming at first unstable leads to the reduced 
matrix 



A-cc A c £ 
And Arc 



(35) 



with entries 



A,. 



Acc = -1 



A»> = 1 



k(k- l)p 2 (tanh/3) 2 + 
kp tanh /3 



gfcV Emio (*~> m (l " yf-™- 1 [tanh(fc -m-l)/3 (tanh/3) 2 ] 
1 - E™=o (m> m (! - P) k ' m tanh(fc - m)/3 

i + E™i ( fc ~> m (! - p) k ~ m ~ l tanh ( fc - m ~ l )P 



1 



eLo (i)p m ( i - p) k ~ m tanh ( fc - m )p 



, YL=q Op" 1 ^ - P) k - m tanh(fc - m)0 
' 1 - E™=o (™)P m (! " P) k ~ m tanh ( fc " m )P ' 



(36) 



The vanishing of its determinant gives the critical temperature T c {p) which depends on p. The determinant is negative 
for p — at all positive temperatures, where the paramagnetic solution is known to be correct, and positive at T = 
for all p > 0, we thus conclude that T c (p > 0) > 0. The explicit value can be calculated numerically from ( |35| ) and is 
shown in figure (11). The critical temperature for small disorder p behaves like 



Tc(p) 



2k 



log(2fcp) 



(37) 



it consequently shows the same asymptotic p-dependence as in the original model, cf. (25). In addition it shows in this 
case the same p-dependence as the crossover temperature found from 2kp£ iQ oc 1 with £ = — 1/ ln(tanh k/3) oc exp{2fc/3} 
for (3 > 1. 



5 




FIG. 11. The inverse phase transition temperature /3 c (p) in the simplified model for k = 2 and k — 3. The dashed lines show 
the asymptotic behaviour given in (137]) . 
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V. SUMMARY AND CONCLUSION 



In conclusion, in the first part of this work we have studied the geometrical properties of small-world networks 
which interpolate continuously between a one-dimensional ring and a certain random graph. The coexistence of a 
more and more diluted local structure and of random long-ranged links leads to some very interesting features: 

• Due to the local structure two neighbouring vertices have in general common neighbours, a fact which leads to 
a certain cliquishness. The clustering coefficient, measuring this property, was found to decrease like (1 — p) 3 
with the fraction p of randomly rewired links. 

• The average length between two points characterizing global properties of the network was found to depend 
strongly on the amount of disorder in the network. A crossover, first proposed in j|, could be worked out: At 
fixed p, the average length between two vertices was found to grow linearly with the system size N <C 0(1/ p) 
for small networks, whereas it grows only logarithmically for large networks N 3> 0(l/p). 

Therefore, the mere notion of "small-world" graph, i.e. the region of disorder where the local properties are still 
similar to those of the one-dimensional ring whereas the global properties are determined by the random short-cuts 
in the graph, depends on its size, and can be extended to smaller and smaller p, taking larger and larger N. 

In the second part these findings where corroborated by the investigation of an Ising model defined on the small- 
world network. In the thermodynamic limit we found the following behaviour for fixed disorder strength p: for large 
temperatures, the system behaves very similarly to the pure one-dimensional system, whereas it undergoes a crossover 
to a mean-field like region for smaller temperatures. Finally, at low but non-zero temperature, we find a ferromagnetic 
phase transition. This underlines again the results of the geometrical investigations that the graph is in its small-world 
regime for any disorder strength at sufficiently large system sizes, i.e. in a region where both geometrical structures 
lead to interesting physical effects. 

Acknowledgment: We are very grateful to G. Biroli, R. Monasson and R. Zecchina for numerous fruitful discus- 
sions. MW acknowledges financial support by the German Academic Exchange Service (DAAD). 



APPENDIX A: BREAKDOWN OF THE FIRST ORDER PERTURBATION THEORY 



In this appendix we want to present the first-order perturbat ion c alculations for small disorder strengths p <C 1 
leading finally to the crossover phenomenon described in section IV C| . We start from the linearized transfer matrix 



Tz in (Si, ...,S fe |S fc+ i, ...,S 2 fe) = exp </ ^ c(Sj) + (i ^ s A+j 



<>J=1 



l-fc 2 p+p]Tc(S) exp{/?S p (S-S p+g )} 
S p,g=l 



(Al) 



and calculate the elements of the fluctuation matrix (|20|) around the paramagnetic saddle point up to first order in 
p. In order to achieve this we use the 2 k (bi-)orthonormalized eigenvectors |A Q ), ((A Q |) a = 1, 2 fc , of the pure and 
unreplicated transfer matrix 



T(°)(Si, S k \S k+1 , ...,S 2k ) = exp \l3j2 S * S i+j 



(A2) 



We choose these eigenvectors to be ordered according to their eigenvalues. The eigenvectors of the replicated pure 
system are therefore given by |a) = |A Q i) <g) • • • (g) |A Q ™), and the corrections of 0(p) can be calculated by using these 
vectors. 

At first we realize that the second derivative of 



fn[c,c] 



5>(S)c(S) + llntr T| 



(A3) 



with respect to c is already of order p 2 and can therefore be neglected. The interesting entries of the fluctuation 
matrix consequently come from the off-diagonal blocks d 2 f n /dcdc. We calculate the derivatives 
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dfn 

dc(S) 



-c(S) 



Ssi,...,s fc _i T ;i«( S ' Si, -, S fe _i|S, Si, Sfe_i) 



tr T," 



(A4) 



d 2 fn 



N 



<9c(S)<9c(R) 



N-i V ( T J 3T '"' . 

EZ^Si S fc _! \ *-lin dc(R) 
" 

3=0 



iJV-j-1 



(S, Si, Sfe_i|S, Si, Sfc_i) 



tr TV 



Due to the fact that 



<9T 



dc{ 



= P ^2 exp \ ^ S p( S ~ S p+i) + X! SiS i+j + ^2 c(Si) 



(A5) 



o,9=l 



'■,J'=1 



is already linear in p, the other T;i n -factors can be replaced by the replication (T^)®" of the pure matrix. Introducing 
two-times the identity 



(A6) 



where (ot| denotes the biorthogonal set of left eigenvectors into (A4) and keeping only the exponentially dominant 
terms proportional to A™ N , we can write 



d 2 fn 



N 



= -<kR-yc pm c pm + M (1 ...i ) (S,R)+ 1 P X M <*(S,R 



dc(S)dc(R) 



(A7) 



a#(i...i) 

and in the limit n — > the fluctuation modes respecting the normalization of c(S) give rise to eigenvectors of the form 



1 



P 



0{p°,(e^°) + ... 



1 - A 2 /Ai 

with Ai and A2 being the two largest eigenvectors of T^ ). For low temperatures, where 1 — A2/A1 <C 1, we have 

1 1 



(A8) 



1-A 2 /Ai l-exp(-i) 



Co 



(A9) 



and the correction in O(p) gets arbitrarily large for low enoug h tem peratures T. This leads directly to the crossover 



in the behaviour of the model for p cx £ 1 discussed in section [VC 



APPENDIX B: FLUCTUATIONS AROUND THE PARAMAGNETIC SADDLE POINT 

In this appendix we are going to present the calculations of the Gaussian fluctuation matrix at the paramagnetic 
saddle point solution for the modified model presented in Section IV. E in order to determine the ferromagnetic phase 
transition temperature for general k and p. We start with equations (28 29|), 



/ n [c,c]=-^c(S)c(S) + llntrT iV 



(Bl) 



T(Si|S 2 ) = e £ ^ 



1 k 



(1 - p) exp{/3S! • S 2 } + P J2 c(S) exp{/3S! • S} 



(B2) 



In the following we need the first and second derivatives of T: 



1G 



<9c(S) 
gTCgijSa) 

aa(s) 
a 2 T(S!|s 2 ) 

dc{S)dc(R) 



(l-p)eKp{/3Si-S 2 }+p5^c(S)ejtp{/3Si-S} 



fcpexp{c(Si)+/3Si -S} 
T(Si|S 3 )*Sx,s 

k(k - l)p 2 exp{c(Si) + /3Si ■ (S + R)} 

(1 - p) exp{/3Sx ■ S 2 } + p c(S) exp^Sx ■ S} 



A— 1 



fc-2 



a 2 T(S!|S 2 ) _ 0T(Si|S 2 ) 



9c(s)aa(R) 

5 2 T(S!|S 2 ) 



flc(S) 
T(Si|S 2 )i5si,s5si,r 



<9c(S)<9c(R) 

The resulting saddle point equations for the calculation of Z™, 

^(SIS) 



(B3) 



c(S) 
c(S) 



trT 

-iJV-l 



TV 



'c(S) 



trT 



(B4) 



have obviously a simple paramagnetic solution of the form c(S) = 1/2™ and c(S) = 2pa((3) n , i.e. a solution, where 
every replicated spin has equal probability. Whether this is correct or not for any finite temperature depends on the 
eigenvalues of the Hessian matrix 



f d 2 f n [c,c\ d 2 f n [c,c] \ 

dc dc dc dc 

d 2 fn[c,c] (9 2 /n[c,c] 

y dc dc dc dc J 



(B5) 



calculated at the before- mentioned saddle point. One important observation is that the structure of all four blocks 
in this matrix is the same, resulting in the possibility of a simultaneous diagonalization of the four blocks, so only 
the submatrices of 4 eig env alues belonging to the same eigenvectors have to be considered. But at first we have to 
calculate the entries of (B5), and we start with the upper left corner: 



d 2 f n 



dc{S)dc(R) 



-7Vc(S)c(R) + 



tr T 



N-l q2 



d 2 T/dc(S)dc(R) 



tr T 



N-2 

E 

j=0 



<9T/<9c(S) T* dT/dc(R) T"-^ 2 



tr T 



(B6) 



The numerator of the second term is dominated by the largest eigenvalue of T which, according to the notation in 
III.E, is | + ...+). We are only interested in the limit n ~ > 0, so we can set all n-th powers to 1 for the simplicity of 
our calculations. 



tr T 



JV-l 



d 2 T 



,N-1, 



d 2 T 



dc{S)dc(R) " vv N ac(S)9c(R) 

= k(k - l)p 2 ex P {c(Si) + /3Si ■ (S + R)} [(1 - p) exp{/3Si • S 2 } + p] 

Si ,S2 

= k(k- l)p 2 e £ (cosh2/?)T a 



(B7) 



The last term in equation (B£) is exponentially dominated by 
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tr dT T .7 dT T N-j-2 _ \ , .. ,.\ J 



dc(S) 0c(R) 



A(n) 



_dT_ 



•+>(- 



E A[/x]U(n)^- 2 < 



<9T dT 



'dc(S) 



1 0c(R) 



E A M 



AT-j-2 



A(n^( M | 



dT 

9c(S)' 



-)(- 



dT 

<9c(R) 



(B8) 



With 



_ST_ 

'a c (s: 



= E ^^((l-p^ 8 * 



;s 2 |m) 



Si .S2 



fcpe e E (* ^"(l -p)^™' 1 [tanh(/c -to- l)/3 tanh/3]"^ (/x) (S|/i) 



<9T 

I— — 

1 9c(R) 



we consequently find 



E fepe e+ ^ Sl ' ((1 -rfe' 381 ' 82 + p) ( M |Si) 
Si ,s 2 

kpe £ [tanh/?]"~ p(/x) (/*|R) 



(B9) 



11 ac(s) - 1 a c (R) A 



tr T 



N 



k — rn — 1 



=*v£E( fc ;V(i-P) 

m=0 V / 

x [tanh(fc-m- (tanh/?) 2 ]"~ p(/X) 



(BIO) 



It is now obvious that the matrix d 2 f n / dcdc has also the eigenvectors The first one, | + ...+), corresponds to 
fluctuations changing the normalization of c(S) and is not allowed. So the second one, | — K..+) (or any other with 
p(/i) = n — 1), is expected to be the dangerous one leading finally to the ferromagnetic phase transition in the Ising 
model. From (|BG|Jb^JdTc|) we obtain for this eigenvalue 



k(k- l)p 2 (tanh/3) 2 



2 *V Em=o ( fc ^ 1 )p m ( 1 - p)"-™- 1 [tanh(fc -m- l)/3 (tanh/3) 2 ] 



(Bll) 



The calculation of the other elements of the fluctuation matrix is done analogously. Here we report only the results. 
The eigenvalue of d 2 f n /dcdc corresponding to the eigenvector | — K..+) is found to be 



kp tanh [3 



- 1 



i+e;=o(™V(i-p) 



k—rn—l 



tanh(/c — m — l)f3 



and for d 2 f n / dcdc we get the entry 



1 + 2 



1 - E™= Op to (i - p) k ~ m tanh (^ - ™)0 



(B12) 



(B13) 



leading to (|35|). 
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